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A  feature  of  many  ill-posed  inverse  problems  is  that  the  Hessian  operator  of  the  data 
misfit  functional  is  a  compact  operator  with  rapidly  decaying  eigenvalues.  This  is  a 
manifestation  of  the  typically  sparse  observations,  which  are  informative  about  a  limited 
number  of  modes  of  the  infinite  dimensional  held  we  seek  to  infer.  The  Hessian  operator 
(and  its  finite  dimensional  discretization)  play  an  important  role  in  the  analysis  and 
solution  of  the  inverse  problem.  In  particular,  the  spectrum  of  the  Hessian  at  the 
solution  of  the  inverse  problem  determines  the  degree  of  ill-posedness  and  provides 
intuition  on  the  construction  of  appropriate  regularization  strategies.  This  has  been 
observed,  analyzed,  and  exploited  in  several  applications  including  shape  optimization 
[1,  2]  and  inverse  wave  propagation  [3,  4,  5],  to  name  a  few. 

Moreover,  solution  of  the  inverse  problem  by  the  gold  standard  iterative  method — 
Newton’s  method — requires  “inversion”  of  the  Hessian  at  each  iteration.  Compactness 
of  the  Hessian  of  the  data  misfit  functional  accompanied  by  sufficiently  fast  eigenvalue 
decay  permits  a  low  rank  approximation,  which  in  turn  facilitates  rapid  inversion  or 
preconditioning  of  the  regularized  Hessian  [3,  6].  Alternatively,  solution  of  the  linear 
system  arising  at  each  Newton  iteration  by  a  conjugate  gradient  method  can  be  very  fast 
if  the  data  misfit  Hessian  is  compact  with  rapidly  decaying  eigenvalues  and  the  conjugate 
gradient  iteration  is  preconditioned  by  the  regularization  operator  [7].  Finally,  under  a 
Gaussian  approximation  to  the  Bayesian  solution  of  the  inverse  problem,  the  covariance 
of  the  posterior  probability  distribution  is  given  by  the  inverse  of  the  Hessian  of  the 
negative  log  likelihood  function.  For  Gaussian  data  noise  and  model  error,  this  Hessian 
is  given  by  an  appropriately  weighted  Hessian  of  the  data  misfit  operator,  e.g.,  [8].  Here 
again,  exploiting  the  low-rank  character  of  the  data  misfit  component  of  the  Hessian  is 
critical  for  rapidly  approximating  its  inverse,  and  hence  the  uncertainty  in  the  inverse 
solution  [4,  5,  9,  10]. 

In  all  of  the  cases  described  above,  compactness  of  the  data  misfit  Hessian  is  a 
critical  feature  that  enables  fast  solution  of  the  inverse  problem,  scalability  of  solvers  to 
high  dimensions,  and  estimation  of  uncertainty  in  the  solution.  With  this  motivation, 
here  we  analyze  the  shape  Hessian  operator  for  inverse  acoustic  shape  scattering 
problems,  and  study  its  compactness.  Our  analysis  is  based  on  an  integral  equation 
formulation  of  the  Helmholtz  equation,  adjoint  methods,  and  compact  embeddings 
in  Holder  and  Sobolev  spaces.  These  tools  allow  us  to  state  the  shape  derivatives 
in  a  Banach  space  setting,  and  then  to  analyze  the  shape  Hessian  in  detail.  In 
particular,  the  Gauss-Newton  component  of  the  full  Hessian  is  shown  to  be  a  compact 
operator,  and  the  decay  rate  of  its  eigenvalues  is  quantified  as  a  function  of  the  shape 
smoothness.  Furthermore,  under  certain  conditions,  the  eigenvalues  can  be  shown  to 
decay  exponentially. 

The  remainder  of  the  paper  is  organized  as  follows.  Section  2  briefly  derives  and 
formulates  two  dimensional  forward  and  inverse  shape  acoustic  scattering  problems, 
followed  by  Section  3  on  a  general  framework  for  shape  derivatives  in  a  Banach  space 
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setting.  Using  the  results  in  Section  3  and  a  Lagrangian  approach,  we  then  derive  shape 
derivatives  for  the  inverse  shape  scattering  problem  in  Section  4.  Section  5  justifies 
the  shape  derivations  by  studying  the  well-posedness  of  the  (incremental)  forward  and 
(incremental)  adjoint  equations,  and  the  regularity  of  their  solutions.  Next,  we  analyze 
the  shape  Hessian  in  Holder  spaces  in  Section  6,  and  then  extend  the  analysis  to  Sobolev 
spaces  in  Section  7.  Section  8  expresses  the  decay  rate  of  the  eigenvalues  of  the  Gauss- 
Newton  component  in  terms  of  the  shape  smoothness.  In  order  to  validate  our  theoretical 
developments,  we  give  analytical  as  well  as  numerical  examples  in  Sections  9  and  10. 
Finally,  the  conclusions  of  the  paper  are  presented  in  Section  11,  and  straightforward 
extensions  of  two  dimensional  results  to  three  dimensions  are  discussed  in  the  Appendix. 

2.  Forward  and  inverse  shape  scattering  formulations 

2.1.  Forward  shape  scattering  formulation 

For  simplicity  of  exposition,  we  shall  exclusively  work  with  the  two  dimensional  setting; 
extensions  to  three  dimensions  will  be  presented  in  the  Appendix.  We  further  assume 
that  the  scatterer  (for  convenience,  one  scatterer  is  considered,  but  all  the  results 
in  this  paper  hold  true  for  multiple  scatterers)  under  consideration  is  sound-soft.  If  the 
incident  wave  is  a  plane  wave,  we  can  eliminate  the  time  harmonic  factor  e~luJt,  where 
i 2  =  —1,  and  the  acoustic  scattering  problem  can  be  cast  into  the  following  exterior 
Helmholtz  equation  [11]: 


V2U  +  k'2U 
U 


lim  y/r 

r— >00 


0 

- u 1 

0, 


in  Q,  (la) 

on  rs,  (lb) 

(lc) 


where  k  is  the  wave  number,  U  the  scattered  held,  U1  the  incident  held  which  is  assumed 
to  be  an  entire  solution  of  the  Helmholtz  equation  (la),  H  the  exterior  domain  given 
by  =  M2  \  f Is,  and  (lc)  the  radiation  condition  (lc)  which  is  assumed  to  be  valid 
uniformly  in  all  directions  p^. 

We  have  derived  the  governing  equations  (1)  for  two  dimensional  acoustic  scattering 
under  time  harmonic  incident  wave  assumption.  It  turns  out  that  two  dimensional 
electromagnetic  scattering  on  perfect  electric  conducting  obstacles  is  governed  by  the 
same  set  of  equations.  Consequently,  all  the  results  in  this  paper  are  valid  for  both 
acoustic  and  electromagnetic  scattering  problems  in  two  dimensions. 


2.2.  Inverse  shape  scattering  formulation 

For  the  inverse  problem,  the  task  is  to  reconstruct  the  scatterer’s  shape  given  scattered 
held  data  observed  at  some  parts  of  the  domain.  For  simplicity  in  the  following  analysis, 
the  observed  scattering  data  is  assumed  to  be  noise-free. 
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The  inverse  task  can  be  formulated  as  the  following  PDE-constrained  shape 
optimization  problem: 


subject  to 


min  J  =  1  ATx)  \U  -  Uobs  1 2  dQ, 

(2) 

Jsi  ' 

V2!/  +  k2U  =  0 

in 

(3a) 

u  =  -u1 

on  rs, 

(3b) 

dlJ  \ 

- - ikU  =  0, 

dr  j 

(3c) 

where  quantities  with  superscript  “obs”  are  the  observed  data,  AT(x)  denotes  the 
observation  operator  with  compact  support  and  supp  K  c  fb  We  identify 


/C(jP  /  Kip  dfl  / 


where  lSUppA'  is  the  characteristic  function  of  the  set  supp  K .  In  particular,  if  the 
measurements  are  pointwise  at  x.°bs,j  =  1, . . . ,  Nobs,  we  have 


For  simplicity  in  writing,  we  define  T&  =  supp  K . 


3.  Shape  derivatives  in  a  Banach  space  setting 

If  we  restrict  our  attention  to  a  special  shape  space  which  is  Banach,  shape  calculus 
becomes  usual  differential  calculus  on  Banach  spaces  and  many  interesting  conclusions 
can  be  drawn.  As  we  shall  see  in  the  sequel,  only  Fubini’s  theorem  and  Leibniz’  rule  are 
necessary  to  derive  the  first  and  second  order  shape  derivatives  in  this  setting. 

Following  [12,  13],  we  represent  the  shape  by  its  boundary.  In  particular  we  assume 
that  the  scatterer  fis  $1  M2  is  a  simply  connected  domain  and  starlike  with  respect  to 
the  origin.  Thus,  its  boundary  dlls  can  be  parametrized  as 

d Us  =  Ts  =  {r  =  r(9)er  :  9  e  [0,  27t] }  ,  er  =  [cos  9,  sin  9}T .  (4) 

We  assume  that  Ts  belongs  to  Holder  continuous  class  Cm,a  for  0  <  a  <  1.  That  is,  the 
radius  r  lives  in  the  Holder  continuous  space  Cm’"([0,  2n])  with  periodic  condition 

rb)(o)  —  r^)(27r),  j  —  0, ...  ,m,  (5) 

where  the  superscript  ( j )  denotes  the  jth  derivative  with  respect  to  9.  To  the  end  of 
the  paper,  unless  otherwise  stated,  functions  defined  on  [0,  27r]  are  periodic  in  the  sense 
of  (5). 
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We  are  now  in  the  position  to  derive  the  shape  derivatives.  For  the  purpose  of  this 
paper,  it  suffices  to  consider  the  first  order  shape  derivative  of  the  following  functional 


1=  f  /(x)  dn.  (6) 

Jn 

The  following  Lemma  provides  the  shape  derivatives  of  X  that  will  be  used  later  in  the 
derivation  of  the  shape  Hessian  for  our  inverse  shape  scattering  problems  (an  analogous 
result  for  interior  problems  can  be  found  in  [13]). 

Lemma.  1  Assume  that  f  G  C1  (M2)  thenX  is  twice  continuously  Frechet  differentiable 
for  all  r  G  C1  ([0,  27 r]),  and  its  shape  derivatives  are  given  as 


DI(r\ r) 
D2X[r\  r,  r) 


-2?r 


frr  dO  = 


/ 


/  o 


\Jr2  + 


.12 


ds, 


n2n/of  r  A 

— - 1 —  rrr  dt)  = 


i  o 


de. 


r 


d /  / 

der 


rjr»fY»rjr» 


r  J  \J r2  +  r'2 


ds, 


(7a) 

(7b) 


for  all  r,  r  G  C 1  ([0,  27t]). 

Proof. 

We  use  the  Leibniz  rule  to  compute  the  first  Gateaux  variation  to  obtain  the  shape 
derivative  formulas  (7a)  and  (7b).  Then  it  is  obvious  that  both  DX(r;  r)  and  D2X(r ;  r,  r) 
are  linear  and  continuous  with  respect  to  r  (and  r).  Now  the  continuity  of  DX{r ■;  r)  and 
D2Xfr ;  r,  r)  with  respect  to  r  is  straightforward  owing  to  /  G  C1  (M2).  Hence,  a  classical 
result  on  sufficiency  for  Frechet  derivative  [14]  ends  the  proof.  □ 


4.  Shape  derivative  derivations  for  inverse  wave  scattering  problems 


In  this  section  we  derive  the  shape  gradient  and  shape  Hessian  using  a  reduced  space 
approach,  and  the  justifications  for  our  derivations  are  provided  in  the  next  section.  We 
begin  with  a  useful  observation  on  the  radiation  condition.  Since  the  radiation  condition 
(lc)  is  valid  uniformly  in  all  directions  tAt  ,  we  rewrite  the  radiation  condition  as 


dU_ 

dr 


ikU  =  (p(r)  =  o  (r  1 ^2)  , 


where  r  is  the  radius  of  a  sufficiently  large  circle  Too. 

It  can  be  seen  that  the  cost  functional  (2)  is  real- valued  while  the  constraints  (3a)- 
(3c)  are  complex- valued.  Consequently,  the  usual  Lagrangian  approach  will  not  make 
sense  and  care  must  be  taken.  Following  Kreutz-Delgado  [15] ,  we  define  the  Lagrangian 
as 


C  =  J+  f  u  ( V2U  +  k2U)  dn+  f  us(U +  U1)  ds+  f  ur  ( ^  - 
j  j  r  s  -'Too  v 

+  f  u  (V277  +  k2U)  dn  +  j  us(u  +  UI^j  ds+  f  ur  +  ikU  -  ds,  (8) 

J  Q  J  r g  JToo  \  / 


ikU  —  (p)  ds 
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where  the  overline,  when  acting  on  forward  and  adjoint  states  (and  their  variations), 
denotes  complex  conjugate. 

Taking  the  first  variation  of  the  Lagrangian  with  respect  to  u,  us,ur  in  the  directions 
u,  us ,  ur  and  arguing  that  the  variations  u,  us ,  ur  are  arbitrary  yield  the  forward  equations 
(3a)-  (3c). 

Now  taking  the  first  variation  of  the  Lagrangian  with  respect  to  U  and  arguing  that 
its  variation  U  is  arbitrary  yield  the  following  adjoint  equations: 


V2u  +  k2u  =  —K  (, U  -  Um )  in  ft, 

u  —  0  on  Ta, 

, —  (  du  \ 

Inn  vr  w — I-  iku  =  0. 

r—koo  \  Or  J 

The  other  adjoints  variables  are  found  to  be 

du  ^  „ 

us  =  —  on  1  s,  and  ur  =  —  u  on  Too, 

on 

and  they  are  eliminated  so  that  the  Lagrangian  now  becomes 


(9a) 

(9b) 

(9c) 


C  =  J  +  I  u  (V2U  +  k2U)  +  V  ■  |(C!  +  //')  VS]  eld 

~l  ds-J(u  +  u')^ds 


+  u  (V2f/  +  k2U)  +  V 


u  +  u1)  Vu 


-du 


l  u{^+ikU-v)ds-Jr  (u+u‘^ds- 


(10) 


Now  the  shape  derivative  of  the  Lagrangian  (10)  can  be  obtained  using  formula  (7a), 
he.> 


-27r  n 


DJ  (r;  r)  = 


V  (U  +  U1)  ■  Vu  +  V  (U  +  U1)  ■  Vu  rr  dO, 


(11) 


where  the  boundary  conditions  for  both  forward  and  adjoint  states  on  the  scatterer’s 
surface  have  been  used  to  lead  to  (11). 

For  the  sake  of  convenience  in  deriving  the  shape  Hessian,  the  state  and  adjoint 
equations  are  best  expressed  in  the  weak  form.  As  a  direct  consequence  of  the  above 
variational  calculus  steps,  the  weak  form  of  the  forward  problem  reads 


5  (r,  U)=  u  (V2U  +  k2U )  +  V  ■  [(U  +  U1)  Vu]  dft 

Jn 


[  -u(+-rkU-Ads-t 


du 


(U  +  U1)  — ds  =  0 ,  Vu, 


(12) 
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r  (r,  U,u)=  U  [V2u  +  k2u  +  K  (, U  -  Um )]  +  V  ■  (uVU)  dQ. 


—  /  Q\i  \  r  qjj 

U  (  — — h  iku  ds  —  a—  ds  =  0,  VC/. 


Next,  the  shape  Hessian  is  obtained  by  simply  computing  the  first  variation  of  the 
shape  gradient  DJ  ( r;f )  using  the  shape  derivative  formula  (7b),  i.e., 


D2J(r;r,r)  = 


V  (U  +  U1)  ■  Vu  +  V  (u  +  U ■  Vu 


r  rr  d6 


V  (U  +  U1)  ■  Vu  +  V  (u  +  U ■  Vu  rr  dO 
VC/(r)  •  Vu  +  VC/ (r)  •  Vu  rr  d6 

V  (C/  +  C/')  •  Vu(r)  +  V  (C7  +  C/7)  •  Vu(f ) 


rrdO.  (14) 


As  mentioned  at  the  beginning  of  this  section,  the  reduced  space  approach  is  employed, 
and  hence  the  variations  in  state  U  and  adjoint  u  can  not  be  arbitrary.  Instead,  by 
forcing  the  first  variations  of  S  (r,  U)  and  T  (r,  U,  e )  to  vanish,  U  is  the  solution  of  the 
so-called  incremental  forward  equation: 


u[V2U  +  k2U)dn+  —  U  + 


d(U+  U1) 


r  ds 


u  (  — —  ikU  )  ds  =  0,  Vu, 


and  u  is  the  solution  of  the  incremental  adjoint  equation: 


U  (  V2u  +  k2u  +  K U  )  dSl  +  /  I  u  +  w— r  1  ds 


dU  du 


dn  der 


U  (  — — |-  iku  )  ds  =  0,  VC/. 


The  corresponding  strong  form  of  the  incremental  forward  equation  reads 


V2U  +  k2U  =  0 


u  =  - 


d(U  +  U1) 


on  Ts, 


(17b) 


lim  \fr  — - ikU  =  0. 

r—too  \  Or  / 
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lim  \fr 

r— >-oo 


V2w  +  k2u  = 


u  = 


+  ik/u  )  = 


—KU 

in  O, 

(18a) 

du 

der  r 

on  r.g, 

(18b) 

0. 

(18c) 

Unlike  the  speed  method  [16],  the  Banach  space  setting  always  guarantees  the 
symmetry  of  the  shape  Hessian  due  to  the  standard  result  on  symmetry  of  mixed 
derivatives  in  differential  calculus  [17,  14].  The  symmetry  of  the  shape  Hessian  in  (14) 
is  hidden  in  the  last  two  terms.  Our  next  step  is  to  rewrite  them  into  a  form  where 
the  symmetry  is  apparent.  In  order  to  do  this,  we  choose  r  =  r  and  u  =  u(f)  in  the 
incremental  forward  equation  (15).  For  the  incremental  adjoint  equation  (16),  we  take 
U  =  17(f).  Then,  subtracting  the  forward  equation  from  the  adjoint  equation,  after 
some  simple  integration  by  parts,  gives 


f  d  (U  +  U1)  d u(r) ,  f  dU(r )  du  _  f  ~ 

/  — de - frTrds=  ~frTd^rds+  /  KU(rMr)dQ- 

J  ry  Uiir  on  j  ps  on  uor 

Moreover,  on  T, ,  we  have  the  following  trivial  identities, 


U  +  U1  =0 
u  =0 


er  ■  n  = 


y/r2+rW2 


V  (e  +  u-) 

v«  =  in. 

d^U+U1)  _  di^J+U1) 


der 


du 

der 


\J  r2_(_r(l)2 

du  r 


\J r2_|_r(l)2 


Thus,  (19)  becomes 

d(U  +  U1)  3 h(f 


r»27T 


r»27T 


r  f  d0  =  - 

on  On  J  q 


cW  +  [  KU(f)U(f)d(l. 

On  On  Ja 


(19) 


(20) 


Finally,  combining  equations  (20)  and  (14)  gives  the  symmetric  form  of  the  shape 
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D2J (r; r,  f)  =  /  K  \U(r)U(r)  +  U{r)U{f ) 


dfl 


Hi{r-,r,f) 

p2n 

dU (r)  du  dU (r) 

du 

rr  d9 

l 

dn  dn  dn 

dn 

H2(r-,r,r) 


/»27T 

dU (r)  du  dU (r)  du 

rr  d9 

l 

dn  dn  dn  dn 

H2(r;f,r) 


-2tt 


d  (U  +  U1)  du  d  (U  +  H1)  8u 


dn  dn 


[hi  (hi 


rr  (19 


-27T  d 


H3(r-,f,r) 

V  (U  +  U1)  ■  Vu  +  V  (u  +  U1)  •  Vk 


<9e 


(19 


r 


Hi  (r;r,r) 


(21) 


5.  Regularity  of  the  forward  and  adjoint  solutions 

In  this  section  we  are  going  to  justify  what  we  have  done  in  Section  4  by  studying  the 
wcll-posedness  of  the  forward  and  adjoint  equations,  and  the  regularity  of  their  solutions. 
We  will  assume  that  the  scatterer’s  surface  Ts  is  sufficiently  smooth  so  that  the  forward 
and  adjoint  solutions  can  be  shown  to  be  classical  using  an  integral  equation  method. 
First  we  introduce  the  standard  surface  potentials  [11,  18], 


S<p(*) 

=  2  [  $(x,y)p(y)ds(y), 

Jrs 

x  g  rs, 

(22a) 

D<p(x) 

■g.z 

x  e  rs, 

(22b) 

L>Xx) 

=2l,  dU)^(y)dsM’ 

x  e  rs, 

(22c) 

2>(x) 

-c> 

x  g  rs, 

(22d) 

where  is  the  zero  order  Hankel  function  of  the  first  kind  for  the  (incremental)  forward 
equation(s),  namely, 

$(x,y)  =  ^01(x-y), 

and  the  zero  order  Hankel  function  of  the  second  kind  for  the  (incremental)  adjoint 
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solution(s),  i.e. , 

*(x,  y)  =  -\Hl  (x-y)  =  --^"(x-y)  . 

Our  analysis  needs  the  following  useful  result  due  to  Kirsch  [19,  20]. 

Lemma.  2  Let  m  G  N  U  {0}  and  a  G  (0, 1].  Then 

i)  Let  Ts  G  Cm+1’a  if  m  >  l,  and  Ts  G  C2  if  m  =  0,  then: 

•  S  and  D  map  Om,“(rs)  continuously  into  Om+1,a(rs). 

•  T  maps  Cm+1’a{Ts)  continuously  into  Cm,a(Ts). 

ii)  Let  Ts  G  Cm+2,a,  then  D*  maps  Cm,a(rs)  continuously  into  Cm+1,a(rs). 

Proof.  See  Kirsch  [20]  for  the  proof.  □ 

Note  that  Cm,a(Ts),  provided  G  Cm,a ,  denotes  the  space  of  m-times  differentiable 
functions  whose  mth  derivative  is  Holder  continuous  with  exponent  a  on  Ts.  If  rs  is 
parametrized  as  in  (4),  where  r  G  Cm,“([0,  27t]),  we  dehne  Om,"(rs)  as  the  space  of  all 
functions  (p  such  that  p  (r)  G  Cm,a([0,  2i r]).  The  following  corollary  follows  immediately 
from  the  preceding  Lemma. 

Corollary  1  Let  rri  G  N  U  {0}  and  a  G  (0, 1].  Suppose  Ts  G  Cm+1,a  if  m  >  1,  and 
Ts  G  C2  if  m  =  0,  then  S  and  D  are  compact  in  both  Cm,a(Ts )  and  Cm+1,“(rs). 

Proof.  The  proof  is  trivial  by  the  following  two  facts: 

i)  For  Ts  G  C0,1  and  i  <  j,  the  embedding  from  CA,a  into  Cl'a  is  compact  [21]. 

ii)  For  continuous  linear  operators  L  :  X  — >■  Y  and  M  :  Y  — »  Z,  the  operator  ML  is 
compact  if  either  L  or  M  is  compact  [22], 

Now  it  is  obvious  that  S  is  compact  in  Cm,a(Ts)  since  it  maps  Cm,a(rs)  continuously  into 
c-m+i,a(rs)  ancl  the  continuous  embedding  from  C'm+1,a(rs)  into  Cm,Q(rs)  is  compact. 
The  proofs  for  other  cases  are  similar.  □ 

A  standard  approach  for  solving  the  (incremental)  forward  equation(s)  using 
integral  equation  methods  is  to  look  for  solution  as  the  combination  of  the  single  and 
double  potentials 

u(x)  =  Dpfx)  —  iS(p(x.)y  xGl2\  rs,  (23) 

where 

Sp(*)=(  $(x,  y)<p(y)  ds(y),  xgM2\Ts,  (24) 

Jrs 

Dp(x)  =  J  ds( y),  x  G  M2  \  rs.  (25) 

The  following  extension  properties  of  S  and  D  determine  the  regularity  of  the 
forward  and  adjoint  solutions. 

Lemma.  3  Assume  m  G  NU  {0}  and  a  G  (0,1].  Let  Ts  G  Cm+1,a  if  m  >  1,  and 
Ts  E  C2  if  m  —  0.  Then 
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i)  S  maps  CTn,a(Ts)  continuously  into  Cm+1,a  (M2  \  Qs). 

ii)  D  maps  Cm+1'a(Ts)  continuously  into  Cm+1’a  (M2  \  f2s). 

Proof.  We  proceed  by  induction.  The  proof  for  m  —  0  is  done  in  [18]  (Theorems 
2.17  and  2.23).  Now  assume  that  the  assertions  are  true  for  m  —  1  and  we  need  to 
show  that  they  hold  for  m  as  well.  We  begin  by  the  following  important  identities: 
Vi  6  I2  \  ks , 


and 


VxSV(x) 


Vx<f>(x,y)^(y)  ds( y) 


S 


ds 


D  (ipn) , 


VxDp(x)  =  /  V: 


d$(x,y) 

<9n(y) 


<p(y)  ds( y)  =  k2S  (pn)  +  VXS  {Vp 


(26) 


(27) 


where  we  have  defined  the  tangent  vector  r  =  ^  and  X?xp  =  ■  We 

now  give  the  proof  for  (26)  and  leave  (27)  for  the  readers  as  an  exercise.  Using 
Vx$(x,y)  =  — Vy$(x, y),  we  have 


V*S<p  =  -  jVy$(x,y)  -T(y)\p  (y)  r  (y)  ds{ y)  -  J  ^  fr)  n  (y)  dsW- 

a#(x,y) 

ds(y) 


A  simple  integration  by  parts  yields 


(x.y) 
ds  (y) 


P  (y)  T  (y)  ds( y) 


t(x.y)UdWM<i8(y), 


and  this  completes  the  proof  of  (26).  Equation  (26)  shows  that  VxS'9?(x)  maps  Um’Q(rs) 
continuously  into  Cm,a  (M2  \  Q,s)  by  the  induction  hypothesis  for  m  —  1.  This  implies 
that  SV(x)  maps  Cm,a(Ys )  continuously  into  Cm+1,a  (M2  \  Qs).  The  argument  for  the 
second  assertion  follows  similarly.  □ 

The  ansatz  (23)  automatically  satisfies  the  Helmholtz  equation  and  the  radiation 
condition,  and  hence  v  is  analytic  in  M2  \  Ts.  What  remains  is  to  determine  ip  that 
satisfies  the  boundary  condition  on  the  scatterer  surface.  Thus,  the  boundary  condition 
determines  the  space  for  ip ,  which  in  turn  suggests  the  correct  space  for  the  solution 
v  by  Lemma  3.  Now,  by  letting  x  approach  a  point  on  Ts,  provided  that  p  G  U(TS), 
and  using  the  standard  limiting  values  on  the  boundary  Ts  for  the  single  and  double 
potentials  [18,  11],  the  trace  of  the  solution  on  Ts  can  be  written  as 


2v(x)  =  (p  +  Dp  —  iSp )  (x),  x  G  Ts. 


(28) 


The  regularity  of  the  forward  and  incremental  forward  solutions  is  now  presented. 

Theorem  1  Assume  rn  G  N  U  {0}  and  a  G  (0,1].  Let  Ts  G  Cm+1,a  if  m  >  1,  and 
Ts  E  C2  if  m  —  0.  There  hold: 
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i)  The  forward  equation  (3)  is  well-posed,  in  particular,  U  G  Cm+1,a  (M2  \  fls),  and 


the  trace  U\ra  G  Cm+1,“(rs).  Both  U  and  U |r  depend  continuously  on  U 1 
the  Cm+1,a -norm. 


m 


ii)  The  incremental  forward  equation  (17)  is  well-posed,  in  particular,  U  G 


Cm’a  (M2  \  Qs),  and  the  trace  U\ra  G  Cm,Q(rs).  Both  U  and  U 


depend 


continuously  on 


ofu+u1) 


der 


in  the  Cm’a-7iorm. 


Proof. 

i)  Equations  (28)  and  (3b)  allow  us  to  write 

(<p  +  Dtp  -  iStp)  (x)  =  -2[/7|rs  (x) ,  x  e  V 


(29) 


Now,  U1  |rs  G  Cm+1’a(rs)  because  the  restriction  of  an  analytic  function  on  a 
curve  is  as  smooth  as  the  curve  is.  By  the  compactness  of  S  and  D  in  Cm+1,a 
from  Corollary  1  and  the  injectivity  of  /  +  D  —  iS  from  [11],  the  Riesz-Fredholm 
theory  [18]  tells  us  that  (29)  is  well-posed  in  the  sense  of  Hadamard  [23],  namely, 
/  +  D  —  iS  :  C,m+1’a(rs)  — »  Cm+1,a(rs)  is  bijective  and  its  inverse  (/  +  D  —  iS )-1  : 
£<m+i,a(rg)  Cm+1,a(rs)  is  bounded.  As  a  result,  tp  G  C'm+1,a(rs),  and  hence 
U  G  Cm+1,a  (M2  \  f2s)  by  Lemma  3.  Moreover,  U\r3  G  Cm+1,a{T s)  depends 
continuously  on  — L/7 1  rs  in  the  Cm+1,a- norm.  It  follows  that  U  depends  continuously 
on  —  UI\r3  as  well. 

ii)  The  proof,  which  is  completely  analogous  to  item  i),  is  clear  from  the  incremental 
forward  boundary  condition  (17b)  and  from  the  result  of  item  i). 


□ 

For  the  adjoint  equations,  we  first  state  their  representation  formulas. 

Proposition  1  The  solution(s)  of  the  (incremental)  adjoint  equation(s)  can  be 
represented  as 


u(x) 


a$(x,y) 

<9n(y) 


$(x,y) 


dv(y) 

<9n(y) 


ds{  y) 


K  (y)$(x,y)dQ,  xG 


(30) 


where 


i<(  y) 


K( y)  [U( y)  —  Pobs(y)]  for  adjoint  equation  (9) 

K(y)U(y)  for  incremental  adjoint  equation  (18) 


(31) 


Proof.  It  is  easy  by  following  the  proof  of  the  representation  theorem  for  the  forward 
equation  [11]  and  noting  that  the  appearance  of  the  last  term  is  due  to  the  inhomogeneity 
of  the  (incremental)  adjoint  equation(s).  □ 
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Proposition  1  suggests  that  one  should  look  for  (incremental)  adjoint  solution(s)  of 
the  form 


v  x  = 


d$(x,y) 

<9n(y) 


-i$(x,y) 


<p{y)ds(y) 


-  /  i^(y)$(x,y)dQ,  x€ 
Jn 


(32) 


We  are  now  in  the  position  to  address  the  regularity  of  the  adjoint  solutions. 

Theorem  2  Assume  me  NU  {0}  and  a  e  (0,1].  Let  Ts  e  Cm+1,a  if  m  >  1,  and 
Ts  G  C 2  if  m  =  0.  Then,  there  hold: 

i)  The  adjoint  equation  (9)  is  well-posed,  in  particular,  u  €  Cm+1,a  (M2  \  (ks  UTb)), 
and  the  trace  n|rs  e  Cm+1,a{Ts). 

ii)  The  incremental  adjoint  equation  (18)  is  well-posed,  in  particular,  u  € 
Cm,a  (M2  \  ( ks  U  Tb))?  and  in  particular,  the  trace  n|rs  e  Cm’Q(rs). 

Proof.  Denote 

ff(x)  =  [  K(y)$fx,y)dn,  x  G  M2,  (33) 

Jn 

then  g  satisfies  the  Helmholtz  equation,  and  hence  analytic,  in  M2  \  It  follows  that 
the  restriction  of  g  on  Ts,  namely  g\rs,  belongs  to  Cm+1,a(rs). 

i)  On  the  scatterer’s  surface,  again  by  the  standard  limiting  values  of  single  and  double 
potentials  on  the  boundary  Ts,  we  have 


(p  +  Dp  -  iS<p  =  2g\Va.  (34) 

As  in  the  proof  of  Theorem  1,  we  conclude  that  u  €  Cm+1,a  (M2  \  Ds)  and 

w|rs  e  cm+1’a( rs). 

ii)  The  result  is  clear  from  the  incremental  adjoint  boundary  condition  (18b)  and  from 
the  result  of  item  i). 

□ 

Let  us  now  justify  the  findings  in  Section  4  in  the  following  theorem. 

Theorem  3  Let  m  e  N  U  {0}  and  a  e  (0, 1].  Suppose  Ts  e  Cm+1,a  if  m  >  1,  and  Ts  e 
C2  if  m  =  0.  Then  the  cost  functional  (2)  is  twice  Gateaux  differentiable.  Furthermore, 
if  m  >  1,  then  the  cost  functional  is  twice  continuously  Frechet  differentiable.  The  shape 
gradient  and  shape  Hessian  are  well  defined  and  given  in  (11)  and  (21),  respectively. 

Proof.  It  is  sufficient  to  consider  two  cases:  m  —  0  and  rn  —  1.  By  Theorems  1  and 
2,  if  m  =  0,  one  has, 


U  e  C1'1  (M2  \  ns) ,  ue  C1’1  (R2  \  (a  u  Tb)) , 
u  e  c0'1  (r2 \ns),  ue  c0’1  (r2  \  (ns  u r6)) , 
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where  we  have  taken  a  —  1.  This  means  all  derivatives  in  the  shape  gradient  (11)  and 
shape  Hessian  (21)  exist  almost  everywhere,  and  hence  are  well  defined.  Furthermore, 
if  m  =  1,  and  hence  G  C2,“,  Theorems  1  and  2  additionally  imply  that  they  are 
continuous  with  respect  to  r.  A  similar  argument  as  in  the  proof  of  Lemma  1  shows 
that  the  cost  is  twice  continuously  Frechet  differentiable.  □ 

6.  Shape  Hessian  analysis  in  Holder  spaces 

In  this  section  we  use  regularity  results  developed  in  Section  5  to  study  the  shape 
Hessian.  For  concreteness,  we  restricted  ourselves  to  two  exemplary  cases  of  the 
observation  operator,  namely,  the  observation  is  everywhere  on  a  closed  curved  Tb 
surrounding  the  obstacle  (we  call  this  case  as  continuous  observation)  and  pointwise 
observation  =  \x<fs\  .  Unless  otherwise  stated,  we  assume  G  Cm+ 1,a,  m  >  1,. 
We  begin  by  studying  the  first  component  of  the  shape  Hessian,  i.e.,  Hi  (r),  which  can 
be  shown  to  be  the  Gauss-Newton  part  of  the  full  Hessian. 

If  Tb  G  Cn,a,  n  G  N  U  {0},  the  proof  of  Theorem  1  implies  that  the  trace  of 
the  incremental  forward  solution  on  Tb  can  be  identified  with  the  following  operator 
composition: 

U\Fb  :  Cm+ha(Ts)  U(r)  =  {D°  -  iS° )  (/  +  D  -  iS)~ 1  Myf  G  Cn’a(Tb), 

where 

Mi  :  Cm+1’a(rs)  3  dr  i-G  Mxdr  =  ^  dr  E  Cm’a(Ts), 

and 

^Mx)  =  2/  4>(x,y)^(y)ds(y),  x  e  Tb, 

Jrs 

^(x)  =  2/  9g^y^(y) xer h. 

Unlike  S  and  D ,  S°  and  D°  have  non-singular  kernels.  In  fact,  they  are  analytic  in  both 
x  and  y  owing  to  x  e  Tb,  y  G  Ts,  and  Tb  D  Ts  =  0.  As  an  immediate  consequence, 
all  the  properties  of  S  and  D  apply  to  S°  and  D°  as  well.  In  particular,  the  following 
stronger  result  holds. 

Lemma.  4  Let  Ts  G  Cm+1,a  arid  Tb  G  Cn,a,  then  S°  and  D°  are  linear,  bounded,  and 
compact  maps  from  Cm+1,a(rs)  to  Cn,a(Tb)  for  all  n  G  Nil  {0}  and  a  G  (0, 1]. 

Proof  We  rewrite  S°  and  D°  as 

S°(pfx)  =  2  J  <f>  (j)^j  ,  r  (9)  j  tp(9)  \] r{9)2  +  [rd)(d)]"  d9,  9  G  [0,  2n] 

/■27T  5$  fr  fd)  ,r  (0))  r - 

D°<p(x)  =  2  J  - V  - J-^{9)^r(9)2  +  [rA){9)f  d9,  9  G  [0,2vr], 
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where  x  =  r(9)ef  with  r(9)  G  Cn'a  [0,  27t],  and  y  =  r(9)er  with  r  (9)  e  Cm+1,a  [0,  27r] . 
Now  it  can  be  observed  that  differentiation  in  9  can  be  interchanged  with  integration 
in  9  due  to  the  non-singularity  and  analyticity  of  the  kernels.  Moreover,  since 
$  (•,  r  (9))  e  Cn’a  [0,  2tt],  we  have 


\\S°v\\Cn,a<^m;r(9))\\c., 


\j r{9)2  +  [rd)(0)]" 


Vra. 


A  similar  result  holds  for  D°,  and  this  ends  the  proof  for  the  hrst  assertion.  The  second 
assertion  is  simply  a  direct  consequence  of  the  first  assertion  and  the  proof  of  Corollary 

1.  n 

Now,  it  is  easy  to  see  that  M\  is  continuous  due  to  Lemma  5  (to  be  stated  and 
proved  momentarily),  and  this  implies  the  compactness  of  U\yh  owing  to  the  continuity  of 
(/  +  D  —  iS)^1  and  compactness  of  (D°  —  iS°).  Using  the  definition  of  adjoint  operator, 
'Hi(r;r,r)  can  be  written  as 


Hi(r;f,f)  =  20  (u|r6(r),  U|r6(r))  =  2^  fe[/|r6(r),  f)  , 

where  0  denotes  the  real  operator  which  returns  the  real  part  of  its  argument,  and 
(•)*  denotes  the  adjoint  operator.  Now  the  compactness  of  U\rb  and  U |£  implies  the 
compactness  of  'Hi(r). 

We  have  proved  the  compactness  of  Hi  (r)  for  continuous  observation.  An 
immediate  question  needs  to  be  addressed  is  whether  the  same  conclusion  holds  true  for 
pointwise  observation  as  well.  The  incremental  forward  solution  evaluated  at  x°bs  reads 


r(r.xf  )  =  /  2 


<9$(xfs,y) 

-2$(x,  ,  y)<p(y) 


dn(y) 


(I  +  D  —  iS )  1  Myr  ds( y) 


U(y) 


=  Ml  [(I  +  D  -  isy1]  r 


M 


LH  r.) 


Therefore  Hi(r;r,r)  becomes 


H\(r)  [r ,  r]  =  2MJ2U  (r,  xf s)  U  (r,  xf s) 
j= 1 

/ 


= 


N° 


\ 


ym^vr  |  ,  r 

J  1  i2(rd  /  L2(Fs) 


(35) 


where  77  is  the  complex  conjugate  of  A f .  i.e.,  Nip  =  Nip.  Equation  (35)  shows  that  the 
dimension  of  the  range  of  Hi(r)  is  at  most  Nobs.  The  compactness  of  Hi(r)  then  follows 
immediately.  Thus,  we  have  proved  the  following  result  on  the  compactness  of  Hi  (r) 
for  both  continuous  and  pointwise  observations. 
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Theorem  4  The  Gauss-Newton  component  of  the  Hessian  operator,  'Hi(r),  as  a 
continuous  bilinear  form  on  C'm+1,a(Ts)  x  Cm+1,a  (T s) ,  is  a  compact  operator. 

In  order  to  study  the  second  component  of  the  shape  Hessian,  i.e.,  TL2  (r),  we 
identify  the  normal  derivative  of  the  incremental  forward  solution  with  the  following 
operator  composition: 

:  Cm’a(Ts)  -G  C,m'1’“(Ts), 
rs 

Myr  ^  i)r'  }l  r  "  =  (U  -  iD*  +  T)  (I  +  D  -  iS)'1  Myr 

on 

for  Myr  G  Cm,a(Ts).  This  is  known  as  the  Dirichlet-to-Neumann  (DtN)  map  [11]. 

Proposition  2  The  DtN  map  is  one-to-one  and  onto  from  Cm,a(Ts)  to  Crn  1,Q(TS), 
and  its  inverse  is  continuous. 

Proof.  The  proof  that  DtN  map  is  bijective  with  bounded  inverse  from  C1,a(Ts) 
to  C°’a(Ts)  is  given  in  [11],  The  extension  of  the  proof  to  the  case  of  mapping  from 
Cm,Q(rs)  to  Cm~1,a(Ts)  is  straightforward  with  the  help  of  Corollary  1,  Lemma  3,  and 
hence  we  omit  the  details  here.  □ 

We  next  prove  the  following  simple  lemma. 

Lemma.  5  Let  u,  v  G  Cm,"([0,  2ir\)  and  rri  G  N  U  {0},  there  hold 

i)  uv  G  Cm’“([0,  27t])  and  ||m;||Cm,a  <  ||«||Cm,a  ||u||Cm,a 

ii)  If  min[0;27r]  \u\  >  e  >  0,  then  ^  G  C'm,Q([0,  27t] ) 

Proof. 

i)  It  is  easy  to  see  that  if  u,v  G  C°’“([0, 2vr] )  then 


dU_ 

dn 


II  HI  CO, «  —  1 1  ^  1 1 0°,“  IK;llco,«  1 

which  in  turn  implies  uv  G  C°’Q([0,  27r])  [24],  Now  u,v  G  Cm,Q([ 0,  27t])  implies 
vf'J\  v1'3'1  G  27t]  ) ,  Vj  <  m.  The  proof  is  now  complete  by  observing  that 

(uv)W  with  k  <  m,  only  involve  products  of  the  type  with  i  <  k,  j  <  k,  and 

that  the  product  ||w||Cm,a  ||u||Cm,a  has  more  terms  than  ||Mu||Cm,a. 
ii)  Let  w  =  1  ju  then  l  <  \w\  <  L  where  l/l  =  max[0]2l  |w|  and  1/L  =  rniii[0:27r]  |u|.  It 
is  trivial  to  show  that  w  G  C0,a([0,  27t]).  Now  observe  that  for  k  <  m,  only 
involve  products  of  three  terms  vj,  v/j\  and  v/A  for  j  <  k,i  <  k,  and  this  ends  the 
proof. 


It  is  convenient  to  denote 

d  (U  +  U1) 


0  = 


der 


du 

g  cm,a(rs),  C2  =  ^  e  cm’a(rs 


If  either  or  (2  is  zero  almost  everywhere,  then  H.2^r)  =  0,  and  hence  it  will  not 
contribute  to  the  full  Hessian.  On  the  other  hand,  if  this  does  not  happen,  then  the 
following  result  on  LOfV)  holds. 
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Theorem  5  Assume  minrs  |Ci|  >  ei  >  0,  min  Ts  |£2|  >  e2  >  0,  then  H2fr),  as  a 
continuous  bilinear  form  on  Cm’“(Ts)  x  Crn,a{Ts),  is  not  compact. 

Proof  The  bilinearity  and  continuity  are  trivial  by  the  definition  of  H2  (r)  in  (21) 
and  the  property  of  the  DtN  map  in  Proposition  2.  Now,  due  to  the  assumptions  on  (fi 
and  Q2,  it  is  obvious  to  see  that  both 

M1  :  Cm’a{Ts)  3  dr  ^  Mxdr  =  0 dr  G  Cm’a{Ts),  (36) 


and 


M2  :  Cm’a(Ts )  3  dr  i-G  M2dr  =  (2rdr  G  Cm’a(rs),  (37) 


are  bijective  and  have  bounded  inverses  due  to  Lemma  5.  On  the  other  hand,  the 
operator  H2fr)  acting  on  f  and  r  can  be  written  as 


Ho 


r;  r,  r 


8U  811 

=  2<%  |  M*  —  (M2r)  +  M2—  (Mpr) ,  r 

8  n  8  n 


(38) 


ia(r.) 


As  can  be  observed,  both  terms  in  the  first  argument  of  the  L2— inner  product  in  (38)  are 
a  composition  of  three  bijective  operators  with  bounded  inverses,  and  they  are  adjoint 
of  each  other.  As  a  result,  H2(r )  is  bijective  with  bounded  inverse,  and  hence  is  not  a 
compact  operator.  □ 

In  order  to  study  Hzfr)  and  H4.fr),  it  is  convenient  to  denote 


d(u  +  u')d u 

S3  —  - X - t  S 

8  n  an 


‘(rs 


9[v(t/+a).v.]r£Cm-1, 

8er 


(r. 


where  we  have  used  Lemma  5  to  conclude  that  £3  G  Cm’“(Ts)  and  (4  £  Cm_1’“(rs).  If 
C3  and  (4  are  zero  almost  everywhere  on  Ts,  then  H${r)  =  0  and  Ha{t)  =  0,  and  hence 
they  have  no  contributions  in  the  full  Hessian.  On  the  other  hand,  if  H3  and  H4  are  not 
trivial,  then  their  mapping  properties  are  given  in  the  following  theorem. 


Theorem  6  Hzfr)  and  H4.fr),  as  continuous  bilinear  forms  on  (7(rs)  x  C'(rs),  are  not 
compact.  If,  in  addition,  minp3  |(j3|  >  e3  >  0  and  minp3  (4  >  64  >  0,  then  H^fr)  and 
Hifr)  are  not  compact  in  Om,Q(rs)  and  Om_1,Q(rs),  respectively. 

Proof.  The  fact  that  H^fr)  and  Hifr)  are  bilinear  and  continuous  is  trivial.  On  the 
other  hand,  their  action  on  r,  r  can  be  written  as 


H3  (r;  f ,  r)  =  21% 
H4  (r;  r ,  r)  =  21% 


8  (U  +  U1)  8u„ 

- a - d_r’r 

an  an 

8  [V  (U  +  U1)  ■  Vu] 
8er 


1 

l2( r.) 

■1  \ 

(39) 

-rf,f  J 

(40) 

L2Hs) 
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The  first  arguments  of  the  L2-irmer  products  in  (39)  and  (40)  are  multiplication 
operators  on  C(TS),  and  hence  Hz  and  Ha  are  not  compact  due  to  a  result  in  [25]. 

Moreover,  if  minrs  C.3  >  e3  >  0  and  mirir3  | 1  >  Q  >  0,  Lemma  5  tells  us 
that  Hz (r)  and  Hi(r)  are  invertible  multiplication  operators  with  bounded  inverse  in 
Cm,Q(rs)  and  Cm~1,a(rs),  respectively.  Consequently,  they  are  not  compact.  □ 

remark  1  Ifm  =  0,  and  hence  Ts  G  C 2 ,  results  for  H\  (r)  and  Hz  (r)  still  hold,  but  not 
for  H2  (r)  and  Ha  (r).  It  is  not  clear  to  us  whether  the  DtN  map  is  still  continuously 
invertible  in  this  case.  Nevertheless,  if  a  =  1,  Ha  (r)  is  a  multiplication  operator  in 
Lp( 0,  27 r),  1  <  p  <  00,  and  hence  not  compact  in  Lp  (0,  27t)  [26]. 

7.  Shape  Hessian  analysis  in  Sobolev  spaces 

The  (non-)compactness  of  the  shape  Hessian  components  in  Section  6  has  been  carried 
out  in  Holder  spaces.  This  is  natural  due  to  our  regularity  study  in  Section  5.  In  this 
section,  we  briefly  show  that  it  is  possible  to  extend  most  of  the  results  to  a  Sobolev 
space  setting.  To  the  end  of  this  section  we  conventionally  use  C2,1  for  m  =  {0, 1}  in 
the  expression  Cm+1,1. 

We  first  recall  some  important  mapping  properties  of  surface  potentials  in  Sobolev 
spaces  [19]. 

Lemma.  6  Let  s£R,s>  — 1/2,  and  m  be  the  smallest  integer  greater  or  equal  |s|. 

i)  Let  Ts  G  Cm+1,1.  Then 

•  S  and  D  map  HS(TS)  continuously  into  HS+1(TS ) 

•  T  maps  HS+1{TS )  continuously  into  HS(TS ) 

ii)  Let  Ts  G  Cm+2,1,  then  D*  maps  HS(TS )  continuously  into  HS+1(TS). 

The  following  compactness  result,  analogous  to  Corollary  1,  is  a  direct  consequence  of 
Lemma  6  and  Rellich  theorem  on  compact  embeddings  of  Sobolev  spaces  [24,  27]. 

Corollary  2  Let  s  G  M,  s  >  —1/2,  and  m  be  the  smallest  integer  greater  or  equal  |s|, 
and  Ts  G  Cm+1,1.  Then,  S  and  D  are  compact  in  both  HS(TS)  and  HS+1(TS). 

Thus,  the  Riesz-Fredholm  theory  still  holds  to  deduce  that  (/  +  D  —  iS )  is  bijective 
with  continuous  inverse  in  both  HS(TS )  and  HS+1(TS),  since  (I  +  D  —  iS )  is  injective  in 
I?  (U)  [19], 

A  result  similar  to  Lemma  4  reads  as  follows. 

Lemma.  7  Let  s,1gR,s>  — 1/2,  m  be  the  smallest  integer  greater  or  equal  |s|,  and 
n  be  the  smallest  integer  greater  or  equal  |f|.  Suppose  T;>  G  Cn' 1  and  Ts  G  Cm+11.  Then 
S°  and  D°  are  linear,  bounded,  and  compact  maps  from  Hs{[ 0, 27r])  to  ^([0,  27r])  for  all 
s,  t  G  M,  s  >  — 1/2. 

Proof.  We  present  a  proof  for  S°  using  the  Sobolev  space  theory  for  periodic 
functions  developed  in  Kress  [24],  and  the  proof  for  D°  follows  similarly.  Denote 

$  (§,  0)  =  $  (r  (0)  ,  r  (0))  y/r2(0)  +  [r(b(0)]2, 
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then,  we  immediately  have  <1(0,  6)  G  C n'1  [0,  2n]  x  Cn’1  [0, 2ir\.  As  a  result,  l>(0, 6)  admits 
a  Fourier  series,  i.e., 

k  j 

and  its  Fourier  coefficients  decays  faster  than  n-order  polynomials  in  j  and  than  m-order 
polynomials  in  k,  i.e., 

\cj,k\2  <  OO, ,  ^2  k2m  \cjtk\2  <  oo.  (41) 

j,k  j,k 

Let  us  denote  dk  =  A-  f27T  ip(9)etke  d§,  then  we  have 

S\  =  4nJ2(j2cj,kdk')  eije. 

" - V - ' 

Tj 


Next  using  Cauchy- Schwarz  inequality  and  (41),  the  linearity  and  boundedness  of  S° 
are  readily  available  such  as 


iisviih  =  (totx  (i + A'rci2  <  (4>y 

3 


(1  -  J2)1  rM. 
(1  +  k2)3' 


(1  +  k2)s'  \dk\ 


<oo 


II2 

11 Hs ' 


where  —  1  <  s'  <  —1/2.  The  second  assertion  follows  immediately  since  the  embedding 
from  Hs  [0,  27t]  to  Hs'  [0,27 r]  is  compact  [24,  27].  □ 

We  next  need  the  mapping  properties  of  the  potentials  S  and  D  to  investigate  the 
DtN  map.  A  result  due  to  Kirsch  [19],  analogous  to  Lemma  3,  states, 

Lemma.  8  Let  s£l,s>  —1/2,  and  m  be  the  smallest  integer  greater  or  equal  |s|. 

i)  If  Ts  G  Cm+1,1,  then  S  can  be  extended  to  bounded  linear  operator  from  Hs  (Ts) 

inf®  azm  (»)  ■ 

ii)  If  Ts  G  C™’1,  then  D  can  be  extended  to  bounded  linear  operator  from  Hs  (Ts)  into 

KH  (n). 

Here  comes  an  extension  of  the  DtN  map  in  Proposition  2  from  Holder  spaces  to 
Sobolev  spaces. 

Proposition  3  Let  s  G  M,  s  >  — 1/2,  m  be  the  smallest  integer  greater  or  equal  s  | ,  and 
G  Cm+1,1.  Then,  the  DtN  map  is  bijective  with  continuous  inverse  from  Hs  (Ts)  to 

h*-1  (ra). 

Proof.  Using  Corollary  2  and  Lemma  8  instead  of  Corollary  1  and  Lemma  3,  the 
proof  follows  the  same  line  as  the  proof  of  Proposition  2.  □ 

We  are  now  in  the  position  to  discuss  our  main  results  on  the  (non-) compactness 
of  each  component  of  the  full  shape  Hessian. 
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Theorem  7  s  G  M,  s  >  —1/2,  m  be  the  smallest  integer  greater  or  equal  |s|,  and 
Ts  G  Cm+1’\ 

i)  Hi  (r)  is  compact  in  Hs  (Ts). 

ii)  Assume  minrs  |Ci|  >  e4  >  0,minrs|£2|  >  e2  >  0,  then  Hi(r)  is  bijective  with 
continuous  inverse  in  Hs  (Ts). 

in )  Assume  minps  (3  \  >  63  >  0,  then  H3  (r)  is  bijective  with  continuous  inverse  in 

hs  (ra). 

iv)  Assume  minps  |£4|  >  e4  >  0,  then  Hi (r)  is  bijective  with  continuous  inverse  in 

hs~1  (rs). 

Consequently,  H2  (r),  H3  (r),  and  Ha  (r)  are  not  compact. 

Proof.  With  the  above  developments,  the  proofs  of  these  assertions  follow  exactly 
the  same  line  as  those  of  Theorems  4,  5,  6. 

i)  Theorem  1  and  Lemma  5  imply  that  M\  is  a  continuous  map  in  Hs  (Ts).  Since 
(/  +  D  —  iS )  is  continuously  invertible  due  to  Corollary  2  and  (. D°  —  iS° )  is 
compact  due  to  Lemma  8,  the  compactness  of  Hi  (r)  follows  for  both  continuous 
and  pointwise  observations. 

ii)  With  the  assumptions  minps  ]£i|  >  e±  >  0  and  rnirir.,  |/2|  >  e2  >  0,  Mi  and  M2 
are  bijective  with  continuous  inverse  in  Hs  (Ts).  Together  with  the  continuous 
invertibility  of  the  DtN  map,  we  conclude  that  H2  (r)  is  continuously  invertible. 

iii)  Under  the  assumption  minps  |^3|  >  63  >  0,  Hz{r)  is  a  bijective  multiplication 
operator  with  continuous  inverse  in  Hs  (Ts). 

iv)  Under  the  assumption  minps  |^4|  >  e4  >  0,  Ha (r)  is  a  bijective  multiplication 
operator  with  continuous  inverse  in  Hs~l  (Ts). 

□ 

8.  Eigenvalues  of  the  shape  Hessian 

We  have  showed  that  the  Gauss-Newton  component  of  the  shape  Hessian,  namely, 
H\  (r),  is  compact  while  others  are  not.  This  implies  the  ill-posedness  of  the  inverse 
problem  (2)-(3c),  which  is  now  explained  in  more  detail.  Suppose  we  are  solving  the 
inverse  problem  (2)-(3c)  iteratively  using  a  Newton  method.  As  the  iterated  shape  r 
is  sufficiently  close  to  the  optimal  shape,  all  Hessian  components  are  negligible  except 
Hi  (r).  That  is,  one  has  to  invert  Hi  (r)  in  order  to  obtain  the  Newton  steps.  Due  to 
the  compactness  of  H\  (r),  solving  for  the  Newton  steps  is  an  example  of  solving  linear 
equations  of  the  first  kind,  which  is  ill-posed  (e.g.  [11]).  The  degree  of  ill-posedness 
is  reflected  by  the  decay  of  the  eigenvalues  of  Hi  (r).  If  the  eigenvalues  decay  slowly 
to  zero,  the  problem  is  called  mildly  ill-posed.  If  the  decay  is,  however,  very  rapidly, 
the  problem  is  severely  ill-posed  [11].  This  begs  for  a  study  on  the  decay  rate  of  the 
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eigenvalues  of  Hi  (■ r ).  We  begin  by  rewriting  Hi  (r)  in  terms  of  operator  composition  as 


Hi(r-,r,r )  =  (42) 

2^  (m*1C  [( D°  -  iS°)  (/  +  D  -  iSy1]*  (D°  -  iS°)  (/  +  D  -  iS)'1  Mif,rj  ) , 

for  continuous  observation,  and  as 


Hi(r\  r,  r )  = 

/  /  Nobs 


(43) 


\ 


£  M*  [( I  +  D -  iS)  l;-<I>;,Ul  [{I  HD-  iS) 

V  W 


L2W)  /  L2(rs) 


for  pointwise  observation.  We  now  have  the  following  asymptotic  result  on  the  decay 
rate  for  both  continuous  and  pointwise  observations. 

Theorem  8  Assume  me  NU  {0}  and  a  e  (0,1].  Let  Ts  e  Cm+l,a  if  m  >  1,  and 
Ts  e  C 2  i/m  =  0.  Tden,  tde  nth  eigenvalues  of  Hi  (r)  asymptotically  decay  as 


Al,n  —  O 


n 


2m+l+«  ^ 


Proof.  The  fact  that  Hi  (r)  is  Hermitian  and  semi-positive  definite  is  clear  from 
(21).  In  fact,  it  is  positive  definite  for  the  continuous  observation  due  to  the  unique 
continuation  of  solutions  of  the  Helmholtz  equation.  By  the  analyticity  of  $  (x,  y), 
Mi  e  Cm’a(Ts),  and  \Jr 2  +  r'2  e  Cm’"(Ts),  Equations  (42)  and  (43)  show  that 
Hi  (r)  G  Cm’a  ( [0,  27t]  x  [0,  27t]).  Using  the  main  theorem  in  [28]  completes  the  proof.  □ 


remark  2  It  is  important  to  emphasize  that  the  result  in  Theorem  8  is  asymptotic,  and 
hence  is  only  valid  for  sufficiently  large  n.  The  decay  rate  can  be  improved  further  if  the 
shape  space  and  Mi  are  analytic.  In  that  case,  invoking  a  result  in  [29]  one  can  conclude 
that  the  decay  rate  is  in  fact  exponential. 


9.  An  analytical  example 

In  this  section  we  present  an  analytical  example  in  which  eigenvalues  can  be  expressed 
in  terms  of  Bessel  functions  and  eigenfunctions  can  be  shown  to  be  Fourier  modes.  Most 
of  the  results  are  elementary  but  the  proofs  arc  long  and  tedious,  so  most  of  the  details 
are  omitted  to  keep  the  length  of  the  paper  reasonable. 

We  first  recall  that  the  plane  wave  elkx  in  positive  x-direction  can  be  represented 
as  the  superposition  of  an  infinite  number  of  cylindrical  waves  [30],  i.e. , 

OO 

eikx  =  iNMkr)eiNe. 

N=—oo 

Next,  we  assume  that  the  incident  wave  is  one  of  such  cylindrical  waves,  namely, 


Uic  =  JN(kr)eiNe, 


(44) 
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which  is  an  analytic  function  in  M2.  We  further  assume  that  the  synthetic  observation 
data  Uobs,  as  the  scattered  field  obtained  from  a  circular  scatterer  of  radius  r  =  c,  are 
observed  everywhere  on  a  circle  of  radius  r  =  b.  Now,  we  would  like  to  investigate  the 
shape  Hessian  evaluated  at  a  circular  scatterer  of  radius  r  —  a  <  b. 

For  incident  plane  wave,  analytical  solution  for  circular  scatterers  is  standard 
[30],  and  one  can  adapt  the  derivation  easily  to  obtain  analytical  solution  for  incident 
cylindrical  waves  given  by  (44).  In  particular,  the  solution  of  the  forward  equation  reads 


U  = 


JN(ka) 


HlN(kr)e 


iNd 


HlN{ka) 

from  which  the  synthetic  observation  data  follows,  namely, 

JN{kc) 


jjobs  _ 


HUkc. 

The  total  field  is  now  readily  available  as 


■Hh(kr)e 


iNd 


u  +  ulc  = 


-  M^K(kr)' ~'m 


In  (hr ) 


Similarly,  the  solution  of  the  incremental  forward  equation  can  be  shown  to  be 


OO 

U(f)  =  V  An(f)H)(kr)eM, 

n=— oo 


where 


Cjy(ka )  1 


-2?r 


Hn(ko)  -  ./o 


ei{N-n)er(9)  dd,  and  CN(ka)  = 


naH}j(ka) 


By  using  a  Green  function  approach,  one  can  show  that  the  analytical  solution  of  the 
adjoint  equation  is  given  by 


u  =  B 


N 


JN(kr)  - 


JN(ka) 

Hjf(ka] 


H2N(kr ) 


JN9 


where 


Bn  — 


nkb 


9Ni.hr) 

JN^ka )  JN(kc) 


HlN{kb)H2N(kb). 


2  [H}f(ka)  H1N(kc)_ 

The  final  step  is  to  substitute  these  analytical  solutions  into  the  shape  Hessian  (21). 
We  begin  with  the  Gauss-Newton  component  Hi  (a).  After  some  simple  manipulations 
we  have 

OO 

Hi  (a)  =  ^  ^1  ,n<PnN(0)<pnN(0),  (45) 
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b  mm2 

2a2n4  \  Hff(ka)\2  \H4{ka)\ 2 


PnN(9) 


cos  (N  —  n)  9 
sin  (N  —  n )  9 


(46) 

(47) 


As  can  be  seen,  the  eigenfunctions  are  Fourier  modes.  In  order  to  understand  the 
eigenvalues  we  need  the  following  asymptotic  results  for  Bessel  functions  of  large  orders 
[31],  i.e.,  n  »  1, 


Jn(r) 
Yn(r ) 


1  /  er  \  n 


y/2im  v2n/ 

2  / 2n\n 


nn  \er  J 


(48a) 

(48b) 


Since  the  first  term  on  the  right  side  of  (46)  does  not  depend  on  n,  it  can  be  omitted 
without  changing  the  asymptotic  behaviour  of  the  eigenvalues.  Asymptotically,  the 
eigenvalues  can  now  be  estimated  as 


A 


1  ,n 


Yn(kb) 

Yn(ka) 


(49) 


Typically  a<6,  and  (49)  implies  the  exponential  decay  of  Ai>n  with  respect  to  the  index 
n  of  the  Fourier  modes.  For  this  example,  it  is  straightforward  to  prove  the  compactness 
in  L2( 0,  27t)  of  the  Gauss-Newton  component  "Hi (a)  without  using  the  integral  equation 
method  as  in  Sections  6  and  7. 

Proposition  4  Hi  (a)  given  by  (45)  is  a  compact  operator  in  L2(0,2n). 

Proof.  First,  the  series  of  eigenvalues  converges  by  the  root  test.  Second,  if  we  form 
a  series  of  finite  dimensional  approximation  to  Hi(a)  as 


M 

H1M(9j)=  Y  Ai ,„¥>„jv(0W(0),  (50) 

n=—M 


then  Him {9 ,  9)  is  trivially  linear  and  continuous  from  L2( 0,  2tt )  to  L2( 0,  27t)  by  Cauchy- 
Schwarz  inequality  and  the  convergence  of  the  eigenvalue  series.  That  is,  Him (9,  9)  is 
compact.  Finally,  it  can  be  shown  that  Him(9,9)  converges  to  "Hi (a)  in  the  operator 
norm  as  M  approaches  infinity,  again  using  the  convergence  of  the  eigenvalue  series. 
Hence  Hi(a)  is  compact.  □ 

In  Figure  1,  we  plot  Ai>n  against  the  index  n  in  the  linear-log  scale.  Straight 
lines  indicate  exponential  convergence  to  zero,  in  agreement  with  the  estimation  (49). 
Rigorously,  the  exponential  decay  in  (49)  is  valid  only  for  large  n  and  this  is  confirmed 
for  the  case  kb  =  5000  in  which  the  asymptotic  curve  is  also  plotted.  Nevertheless,  the 
decay  is  very  fast  so  that  with  kb  =  10,  for  example,  only  9  eigenvalues  are  sufficient 
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to  represent  the  spectrum  of  "Hi  (a)  accurately  since  the  rest  of  the  spectrum  are  below 
machine  zero.  Figure  1  also  shows  that  as  the  observation  location  is  further  away  from 
the  scatterer,  i.e.,  the  observation  radius  b  is  larger,  the  decay  is  faster,  and  hence  the 
number  of  significant  eigenvalues  is  less.  We  shall  come  back  to  this  point  in  the  later 
discussion. 


Figure  1.  Exponential  decay  of  the  eigenvalues  of  Hi  (a)  for  ka  =  1.  We  show  the 
eigenvalue  plots  for  four  different  values  of  observation  radius,  kb  =  {2, 10, 1000,  5000}, 
together  with  the  asymptotic  curve  for  kb  =  5000. 

For  ^2(0),  simple  algebra  manipulations  show  that 

OO 

T~L  2(0)  ^  ^  ^2,n^PnN  (^)+niV  (^)  i 

n=—o o 


where 


ka 

A2  ,n  —  — 


2t r 


C'N{ka) 


dgN(ka)  Hf^ka)  -  Hf+l(ka) 


dr 


Hf(ka) 


Ignoring  all  the  terms  independent  of  n  and  using  the  asymptotic  formulas  (48a)-(48b) 
yield 

Yn_i(ka)  -  Yn+1(ka) 


X 


2,n 


Now  the  following  estimates 

Yn+l{ka) 


Yn-i(ka) 
Yn+l{ka) 
Yn(ka ) 
Yn-i(ka) 
Yn(ka ) 


n 


Yn(ka ) 

+  ^""3/2  \2(n  +  1) 
eka 

2(n  +  1) 


71  —  1 
71+1 


1  2 


n 


71—1 


n- 1/2  r 


eka 


n- 3/2 


eka 


n 


2  n 
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imply  that  A2,n  grows  with  n.  As  a  consequence,  Ho  is  not  compact  since  the  growth  of 
A2,n  violates  the  necessary  condition  for  a  self-adjoint  operator  to  be  compact. 

For  Hs(a)  and  H±(a),  it  is  transparent  that  they  are  not  compact  as  follows.  Similar 
to  "Hi (a)  and  H2 (a),  they  can  be  written  as 

OO  OO 

^3(^0  ^  ^  ^3,n^PnO  (^)^nO  (^)  ?  ^  ^  ^4:,n^n0  (^V^nO  (^)  •> 

n=— 00  n=— 00 

where 

A3,„  =  2^(f^fA,  A4.„  =  2Iro«[^M  . 

y  or  or  J  or 

As  A3jn  and  A4)„,  are  constants  independent  of  n,  they  violate  the  necessary  condition 
for  compactness  of  Hs(a)  and  H±(a).  As  a  residt,  Hs(a)  and  "H4(a)  are  not  compact. 

The  above  example  is  consistent  with  the  theoretical  results  in  Section  6  even 
though  only  elementary  analytical  means  are  employed  here  instead  of  the  sophisticated 
integral  equation  method.  We  have  shown  that  the  shape  Hessian  is  not  compact  for 
non-optimal  shapes.  However,  as  a  shape  approaches  an  optimal  one,  the  non-compact 
parts  of  the  shape  Hessian,  namely,  %2(r) ,  Hz(r) ,  and  H^r),  converge  to  zero.  In  that 
case,  the  shape  Hessian,  as  a  whole,  converges  to  the  compact  part  H\{r). 

In  this  example,  we  have  two  parameters,  namely,  the  incident  wave  number  k,  and 
the  observation  radius  b.  It  is  then  naturally  to  ask  whether  these  two  parameters  can 
affect  the  ill-posedness,  that  is,  whether  the  problem  is  less  or  more  ill-posed  when  these 
parameters  change  is  of  our  interest.  For  this  purpose,  we,  to  the  end  of  this  section, 
consider  only  H\(a)  and  a  fixed  index  n. 


9.1.  Increase  the  wave  number  k 

From  [31]  we  have  the  following  asymptotic  results  as  k  approaches  00, 

(51a) 
(51b) 

The  eigenvalues  in  (46)  now  asymptotically  become 

k 

Ai,n  ~  —^7,  as  k  — V  00.  (52) 

That  is,  the  eigenvalues  tend  to  be  independent  of  the  index  n  and  grows  linearly  as 
k  increases.  This  in  turns  means  that  H\{a)  tends  to  be  a  non-compact  operator.  In 
other  words,  as  k  — >  00,  the  problem  of  finding  Newton  steps  is  continuously  invertible 
in  the  vicinity  of  an  optimal  shape,  and  hence  the  ill-posedness  due  to  the  compactness 


Jn(kr) 


cos  (kr  —  mr/2  —  7t/4)  , 


Yn(kr )  «  w  sin  (^'r  —  mr/2  —  tt/4)  . 
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of  the  Hessian  is  circumvented.  However,  increasing  the  wave  number  induces  a  different 
kind  of  ill-posedness  known  as  non-uniqueness  of  stationary  shapes  or  multiple  minima 
phenomenon. 

Again,  the  above  result  is  asymptotic  for  all  n,  and  we  would  like  to  know  for 
each  n  when  the  asymptotic  behaviour  is  attained.  Figure  2  shows  Agn  as  a  function 
of  k  for  n  G  {10,20,30,40},  k  G  [1,20],  a  =  1,  b  =  10,  and  N  =  2.  The 
independence  and  increase  of  the  index  n  as  predicted  by  the  asymptotic  result  (52) 
are  clearly  demonstrated.  As  can  be  also  seen,  eigenvalues  with  larger  indices  (smaller 
eigenvalues)  need  larger  wave  number  to  bring  them  to  the  asymptotic  level.  The 
practical  implication  here  is  that  while  it  might  be  “easier”  to  identify  the  scatterer  with 
larger  wave  number,  low  rank  approximation  to  the  H\ (r)  needs  more  work  because  the 
number  of  dominant  eigenvalues  grows  as  k  increases. 


Figure  2.  Variations  of  Agra  for  n  =  {10,  20, 30, 40}  as  k  increases  from  1  to  20.  Other 
parameters  are  a  =  1,  b  =  10  and  N  =  2. 


9.2.  Increase  the  observation  radius  b 

Now  let  us  fix  the  incident  wave  number  k  and  allow  the  observation  radius  b  to  vary. 
The  goal  is  to  study  the  variation  of  eigenvalues  Agn  for  a  fixed  index  n.  Ignoring  all 
constants  independent  of  b  and  m  and  using  the  asymptotic  formulas  (51)  and  (48)  yield 


Agn  ~  b  \H^(kb)  I 


^\Hf{ka)\z  n  \Hf{ka)i 


eka 
2  n 


b  — »  oo, 


(53) 


which  decay  much  faster  than  those  in  equation  (49)  for  a  fixed  but  large  n.  This  fact 
can  also  be  seen  in  Figure  1.  We  conclude  that  as  the  observation  radius  is  larger,  the 
eigenvalues  of  the  Hessian  operator  decay  faster,  and  hence  the  problem  of  finding  the 
Newton  steps  is  more  ill-posed.  In  other  words,  the  number  of  dominant  eigenvalues  is 
less,  which  is  advantageous  for  low  rank  approximation  of  the  Gauss-Newton  part.  It  can 
also  been  observed  in  (53)  that  the  eigenvalues  become  independent  of  the  observation 
radius  b ,  for  sufficiently  large  b. 
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In  Figure  3,  we  compute  the  exact  eigenvalues  n  from  equation  (53)  (ignoring 
constants  independent  of  b  and  n)  for  n  E  {2,5,10}  as  kb  varies  from  2  to  20  and 
ka  =  1.  The  asymptotic  value  in  (53)  is  confirmed  and  attained  for  small  b. 


?  10" 


10  It 


- n  •  2 

- n-5 

—  *n -  10 

asymptotic  n-10; 


10  15  20  25  30  35  40 

kb 


Figure  3.  Variations  of  Ai,n  with  n  €  {2,  5, 10}  as  kb  increases  from  2  to  20  and 
ka  =  1.  Also  shown  is  the  asymptotic  value  in  (53)  for  n  =  10. 


9.3.  On  the  assumption  |£i  >  ei  >  0,  |  C2  >  £2  >0 

Finally  we  would  like  to  check  whether  this  assumption  is  satisfied  in  the  above  example. 
Simple  algebra  manipulations  show  that 

_  —^i  iNg  _  —2  iBN  iNe 

1  7T  aHlf(ka)  ’  2  n  aHfr(ka)  ’ 

that  is,  (2  is  zero  if  kc  and  ka  are  zeros  of  the  Bessel  function  of  the  first  kind  J^-  But 
this  cannot  happen  because  both  U  and  Uobs  would  be  identically  zero  in  that  case. 

Recall  that  the  above  example  is  for  a  cylindrical  wave  which  is  a  part  of  the  plane 
wave.  As  numerically  shown  in  the  following,  the  assumption  is  also  valid  for  an  incident 
plane  wave  for  which  £1  and  (2  become 

=  2 in+leN  iNe  =  \  ^  2in+1BNeN  iNe 

1  ^  naHlrika )  ’  2  ^  naHfrika) 

n=— 00  iV  v  7  n=— 00  iV  v  7 

Figure  4  plots  Ci  and  ( 2  versus  9  for  the  case  of  k  —  1,  a  —  1,  b  —  10,  c  =  2.  As  can  be 
seen,  |Ci|  >  Fl  >  0  and  (2  >  62  >  0. 

10.  Numerical  results 

In  this  section,  we  numerically  compute  the  eigenvalues  of  the  shape  Hessian  (21)  to 
validate  our  theoretical  developments  in  Sections  6  and  7.  We  choose  the  Nystrom 
method  [11]  to  discretize  the  integral  equations  (29)  and  (33).  Since  the  normal 
derivatives  of  the  single  and  double  potentials  are  required  in  the  incremental  forward 
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Figure  4.  <h  and  £2  versus  8  for  the  case  of  k  =  1,  a  =  1,  b  =  10,  c  =  2. 

and  adjoint  equations,  we  use  the  Nystrom  method  of  Kress  [32]  to  treat  hyper-singular 
integrals  properly. 

We  consider  two  shape  spaces.  The  first  shape  space  is  analytic  and  is  given  by 
Fourier  basis  functions: 

K 

r  =  ak  cos (k0)  +  bk  sm(kd).  (54) 

k= o 

The  second  shape  space  consisting  of  C 3  shapes  is  constructed  as  follows.  We  use  B- 
spline  to  fit  the  above  Fourier  basis  in  the  least  squares  sense  and  enforce  periodic 
boundary  condition,  i.e. , 

r0)(0)  =  r(j)(2vr),  j  =  0, 1,  2,  3. 

The  Fourier  basis  functions  are  sampled  sufficiently  well  so  that  the  original  and  B-spline 
fitting  results  look  identical.  The  difference  between  the  two  shape  spaces  is  therefore 
on  r(jl  (0)  for  j  >  1.  Note  that  we  choose  C3  shape  space  since  the  Nystrom  methods 
in  [11,  32]  require  the  third  derivative. 

For  continuous  observation,  we  choose  to  synthesize  the  data  on  the  circle  centered 
at  the  origin  with  radius  b  =  10,  and  take  unity  incident  wave  number  k  =  1  unless 
otherwise  stated.  For  pointwise  observation,  the  data  is  synthesized  at  31  points  equally 
distributed  in  the  interval  y  G  [—6,  b]  and  at  x  =  —b.  For  all  examples,  we  use  trapezoidal 
rule  with  240  points  equally  distributed  in  [0,  27t]  as  numerical  quadrature.  We  are 
interested  in  the  following  drop  and  kite  shapes.  The  original  drop  shape  reads 


x  =  — 2sin(0/2)  T  1,  y  =  sin(0),  f  £  [0,  2tt\. 
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However,  the  actual  drop  geometry  used  in  our  computations  is  shown  in  Figure  5(a);  a 
30-degree  rotated  version  of  the  original  one.  Note  that  we  have  smoothed  out  the  tip 
of  the  drop  so  that  it  is  a  member  of  the  analytic  shape  space.  The  kite  shape,  on  the 
other  hand,  is  given  by 

x  =  cos(f)  +  0.65  cos(2f)  —  0.65,  y  —  1.5  sin(f),  f  e  [0,  27t], 
whose  geometry  is  shown  in  Figure  5(b). 


(a)  Drop  shape  geometry 


(b)  Kite  shape  geometry 


Figure  5.  Shapes  of  interest:  the  drop  and  kite  shapes. 

In  order  to  show  the  efficiency  the  Nystrom  method  and  to  verify  our 
implementation  we  present  a  convergence  result  for  the  drop  shape  (a  similar 
convergence  of  the  kite  shape  is  tabulated  in  [11],  and  hence  omitted  here).  In  particular, 
we  are  interested  in  computing  the  far  held  pattern: 

U00(±)  =  (-7=[  (n  (y)  •  x  +  1)  e_x'y</3  (y)  ds(y),  ||x||  =  1. 

V  8n  Jrs 

We  choose  x  =  (1,0)  and  show  the  real  together  with  the  imaginary  parts  of  U0 0,  namely, 
&  (U0 o)  and  J?  (U^),  versus  the  number  of  Nystrom  quadrature  points  ffNq  in  Table 
1.  As  can  be  observed,  the  exponential  convergence  is  clearly  exhibited,  and  the  result 
suggests  that  using  240  quadrature  points  be  enough. 

Table  1.  Convergence  of  the  Nystrom  method  for  the  drop  geometry. 


#Nq 

^(1U 

^(Foo) 

120 

-1.285454916526683 

0.307119250858291 

240 

-1.285454865187779 

0.307119279365475 

480 

-1.285454865187758 

0.307119279365487 

Our  goal  is  to  numerically  examine  the  necessary  condition  for  an  operator  to  be 
compact,  namely,  the  convergence  to  zero  of  its  eigenvalues.  If  the  set  of  all  eigenvalues 
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has  a  positive  lower  bound  (or  negative  upper  bound),  then  the  operator  is  not  compact. 
However,  even  in  this  case,  it  is  impossible  to  study  all  the  eigenvalues  since  they  are 
countably  infinite.  We  will  therefore  resort  to  investigate  a  small  dominant  part  of  the 
spectrum,  from  which  we  draw  conclusions.  To  the  rest  of  the  this  section,  we  “measure” 
the  degree  of  ill-posedness  by  the  magnitude  of  eigenvalues.  For  example,  given  two  ill- 
posed  inverse  problems,  i.e.,  the  Hessian  eigenvalues  decay  to  zero,  we  say  one  problem 
is  more  ill-posed  than  another  if  the  eigenvalues  of  the  former  are  smaller  than  those  of 
the  latter  at  the  same  indices. 

Figure  6  shows  the  eigenvalues  of  Hi  (rdrop)  for  both  continuous  and  pointwise 
observations  using  the  analytic  shape  space.  The  number  of  shape  parameters  is  chosen 
to  be  2 K  —  1  e  {11,21,31,41}.  As  can  be  seen,  the  numerical  spectrum  as  a  whole 
converges  rapidly  and  exhibits  dimension-independent  property.  The  spectrum  for  the 
pointwise  observation  tends  to  converge  faster  than  that  of  the  continuous  one.  One  can 
also  draw  a  similar  conclusion  for  the  convergence  to  zero  of  the  eigenvalues.  This  is 
intuitively  consistent  since  the  pointwise  case  is  expected  to  be  more  ill-posed,  i.e.,  the 
decay  rate  to  zero  of  the  eigenvalues  is  faster.  Moreover,  the  linear-log  scale  in  Figure  6 
shows  the  exponential  decay  to  zero,  agreeing  with  Remark  2. 


10* 


(a)  Continuous  observation 


(b)  Pointwise  observation 


Figure  6.  Eigenvalues  of  H\  Rdrop)  versus  the  number  of  shape  parameters  using 
analytic  shape  space. 

Similar  to  Figure  6,  we  plot  Ai;n  (rkite)  versus  the  index  n  in  Figure  7  for  both 
continuous  and  pointwise  observations  using  the  analytic  shape  space.  Since  the  kite 
shape  is  non-convex  and  has  small  features  at  the  wing  tips,  the  number  of  shape 
parameters  is  expected  to  be  large  for  the  numerical  spectrum  to  converge.  This  is 
clearly  demonstrated  in  Figure  7  in  which  we  use  2 K  -  1  6  {21,51,101,201}  shape 
parameters.  Compared  to  Figure  6,  five  times  more  shape  parameters  are  used,  yet 
the  numerical  spectrum  does  not  seem  to  converge  for  continuous  observation  case, 
especially  for  small  eigenvalues.  Since  the  pointwise  observation  case  is  more  ill-posed, 
the  convergence  is  expected  to  be  faster  and  this  is  confirmed  in  Figure  7(b).  In  either 
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cases,  the  compactness  of  Hi  (r)  is  clear  from  the  exponential  collapsing  of  eigenvalues 
to  zero  on  the  linear-log  scale. 
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(a)  Continuous  observation 


(b)  Pointwise  observation 


Figure  7.  Eigenvalues  of  Hi  (rkite)  versus  the  number  of  shape  parameters  using 
analytic  shape  space. 

It  is  of  interest  to  see  how  the  eigenvalues  Ayn  behave  in  the  less  smooth  C3 
shape  space  using  continuous  observation  (similar  results  are  observed  for  the  pointwise 
observation  case,  but  not  presented  here).  Figure  8  shows  that  the  eigenvalues  decay 
exponentially  to  machine  zero  for  both  the  drop  and  kite  geometries  and  for  all  number 
of  shape  parameters  under  consideration.  Note  that  this  does  not  contradict  Theorem 
8.  Instead  it  suggests  that  numerical  dominant  eigenvalues,  captured  by  the  shape  space 
under  consideration,  already  converge  to  machine  zero  before  we  can  see  the  asymptotic 
result  predicted  by  Theorem  8.  It  can  be  observed  that,  for  both  geometries,  the 
dominant  numerical  eigenvalues  for  C3  shape  space  in  Figures  8(a)  and  8(b)  are  almost 
identical  to  those  for  analytic  shape  space  in  Figures  6(a)  and  7(a).  Since  the  B-splines 
are  piecewise  polynomial,  the  result  indicates  that  countable  discontinuities  in  higher 
order  derivatives  of  shape  basis  functions  have  insignificant  impact  on  the  numerical 
spectrum. 

We  next  study  the  variation  of  Aiin  when  the  observation  radius  b  increases.  For 
convenience,  we  choose  the  drop  geometry  and  41  shape  parameters  for  the  analytic 
shape  space.  Figure  9(a)  shows  that  for  a  fixed  index  n,  the  corresponding  eigenvalue  of 
the  continuous  observation  case  decreases  initially  but  then  stays  constant  for  sufficiently 
large  b,  which  is  consistent  with  our  analytical  result  in  Section  9.  For  pointwise 
measurement,  however,  the  eigenvalues,  shown  in  Figure  9(b),  are  observed  to  decrease 
constantly  as  O  (£).  This  is  expected  since  we  loose  a  factor  of  b  by  changing  from 
continuous  to  pointwise  observation  as  can  be  seen  in  (21). 

Analogous  to  Section  9,  we  now  study  the  variation  of  eigenvalues  Aiin  when  the 
incident  wave  number  k  increases.  Again,  we  choose  the  drop  shape  and  41  shape 
parameters  for  the  analytic  shape  space.  Figure  10  shows  that,  for  a  fixed  index  n, 
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(b)  Kite  geometry 


Figure  8.  Eigenvalues  of  Hi  (r^i-op)  and  Hi  (rkite)  versus  the  number  of  shape 
parameters  using  C3  shape  space  and  continuous  observation  operator. 


(a)  Continuous  observation 


(b)  Pointwise  observation 


Figure  9.  Variation  of  eigenvalues  of  Hi  (rdrop)  as  the  observation  radius  b  increases 
using  analytic  shape  space. 


the  corresponding  eigenvalue  increases,  in  agreement  with  the  result  and  discussion  of 
Section  9.  That  is,  solving  for  Newton  steps  in  the  proximity  of  an  optimal  shape  is  less 
ill-posed  as  the  incident  wave  number  increases. 

To  the  end  of  this  section,  we  will  numerically  study  the  eigenvalues  of  H2  (r)  and 
H:i  (r)  (Hi  (r)  is  similar  to  H3  (r)  and  hence  omitted).  Since  the  results  for  continuous 
and  pointwise  observations  are  similar,  only  the  latter  will  be  presented  using  the 
analytic  shape  space.  We  synthesize  observation  data  from  the  scattering  held  of  a 
unit  circle  centered  at  the  origin,  and  evaluate  the  eigenvalues  of  H2  (r)  and  "H3  (r) 
at  both  the  drop  and  the  kite  geometries.  Figure  11  plots  the  numerical  spectrum 
of  H2  (r drop)  and  %2  (Cate)  for  various  number  of  shape  parameters.  For  all  number 
of  shape  parameters  under  consideration,  the  plots  suggest  the  smallest  eigenvalue  of 
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(a)  Continuous  observation 


(b)  Pointwise  observation 


Figure  10.  Variation  of  eigenvalues  of  Hi  (rdrop)  as  the  incident  wave  number  k 
increases  using  analytic  shape  space. 


0.014  for  the  drop  and  1.7  for  the  kite.  As  the  number  of  shape  parameters  increases, 
the  numerical  spectrum  resolves  more  eigenvalues  above  the  smallest  eigenvalues.  We 
deduce  that  ^(r)  is  not  compact,  in  agreement  with  our  analytical  results  in  Sections 
6  and  7.  This  validation  would  be  rigorous  if  we  could  check  all  the  eigenvalues  of  "H2, 
but  it  is  again  an  impossible  task.  Hence  we  have  shown  only  the  trend  up  to  201 
eigenvalues. 


(a)  Drop  geometry 


(b)  Kite  geometry 


Figure  11.  Eigenvalues  of  H2  (rdrop)  and  H2  (rkite)  versus  the  number  of  shape 
parameters  using  analytic  shape  space. 

Figure  12  is  similar  to  Figure  11,  but  now  for  H3.  As  can  be  seen,  the  numerical 
results  validate  the  non-compactness  of  "H3  proved  in  Sections  6  and  7.  Again,  up  to 
201  shape  parameters,  the  trend  of  having  smallest  eigenvalues  of  0.004  for  the  drop 
and  1.23  for  the  kite  is  clear. 

It  should  be  pointed  out  that,  unlike  the  compact  Gauss-Newton  part,  the  spectrum 
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Figure  12.  Eigenvalues  of  H3  (rdrop)  and  H3  (rkite)  versus  the  number  of  shape 
parameters  using  analytic  shape  space. 


of  the  non-compact  parts  of  the  Hessian  do  not  exhibit  dimension-independent  property. 

11.  Conclusions 

We  have  presented  a  shape  Hessian  analysis  for  inverse  acoustic  shape  scattering 
problems.  In  either  Holder  or  Sobolev  space  settings,  the  shape  Hessian  is  shown  to 
be  symmetric  and  consists  of  four  components,  the  Gauss-Newton  part  of  which  is  a 
compact  operator  while  the  others  are  not.  The  relationship  between  the  decay  rate 
of  the  eigenvalues  of  the  Gauss-Newton  part  and  the  smoothness  of  the  shape  space  is 
presented,  which  shows  that  the  smoother  the  shape  space  is,  the  faster  the  decay  rate. 
At  the  heart  of  our  analysis  are  the  integral  equation  method,  Riesz-Fredholm  theory, 
and  compact  embeddings  in  Holder  and  Sobolev  spaces.  Analytical  and  numerical 
examples  are  shown  to  be  in  agreement  with  our  theoretical  results.  Ongoing  research 
is  to  extend  our  analysis  to  inverse  shape  electromagnetic  and  inverse  medium  acoustic 
scattering  problems  [33,  34], 
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In  the  following,  we  provide  necessary  ingredients  to  extend  our  theoretical  results  to 
three  dimensional  scattering  problems.  To  begin,  we  again  identify  shapes  with  their 
boundaries,  but  this  time  for  both  two  and  three  dimensions  in  a  unified  manner.  In 
particular  we  assume  that  the  scatterer  fig  £  for  d  —  2,  3  is  a  simply  connected 
domain  and  starlike  with  respect  to  the  origin.  Thus,  its  boundary  d hi 5  can  be 
parametrized  as 

d Qs  =  Ts  =  {r  =  r(0)er  :  9  e  §}  , 


where 


e 


9  if  d 

( 9 ,  if)  if  d 


2 

3  ’ 


and 


6r 


[cos  9,  sin  9]t  Ad  — 2 

[sin d cos^,  sin#  sin^,  cos d]T  if  d  —  3 


S  = 


[0,  2vr]  Ad  =  2 

[0, 7r]  x  [0,  27r]  if  d  —  3 


The  shape  derivatives  for  the  functional  X  in  (6)  can  be  shown  to  be 


DX(r\r )  =  —  frrgd.0 , 


D2I(r;f,f )  = 


df  .  , 

+  (d  _  i)  _ 


where 


9  = 


is  L 


1  if  d  =  2 
r  sin  9  if  d  =  3 


rrr  gd.0 , 


The  following  useful  identities  are  employed  to  derive  shape  gradient  and  Hessian: 


er  ■  n  =  —  =  ,  and  ds  =  gndd , 


n 


where 


^/r2  +  (rd))" 


if  d  —  2 


n  = 


I  ^2  _|_  I 


.(1) 


„(!) 


+  (  dke  1  if  d  ~  3 


where  the  subscripts  9  and  if  denote  partial  derivatives  with  respect  to  9  and 
respectively.  The  fundamental  solution  of  the  Helmholtz  equation  is  now  given  by 


$  (x  -  y)  = 


\Hl  (x  -  y)  if  d  =  2 

1  eifclx-yl  -f  A  _  9  ’ 

4tt  |x— y|  ltd  -6 
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dU 

dr 


ikU  =  (p(r)  =  o  (r^1  d^2)  . 


With  all  these  prerequisites,  it  is  readily  to  verify  that  the  shape  gradient  and 
Hessian  now  read,  for  d  —  2,3, 


DJ  (r;  r) 


V  (U  +  U1)  ■  Vn  +  V  (u  +  f/) 


rr  gdd, 


D2J(r\r,f)=  /  K 
Jn 
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H3(r;r,f) 


V  (U  +  U1)  ■  V«  +  V  (U  +  U  •  Vu 


der 


rrr  gdd . 


H4{r;r,r) 


One  can  also  verify  that  all  the  results  from  Section  5  to  Section  7  hold  for  three 
dimensional  setting  as  well  with  minor  adjustments;  hence  we  omit  the  detail.  Results 
on  the  decay  of  eigenvalues  of  the  Gauss-Newton  part  similar  to  that  of  Section  8  can 
be  extracted  from  [35]. 
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